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Amendments to the Claims 

Please withdraw Claims 1-37. Please amend Claims 38-40, 43, 44, 47, 49, and 52-56. 
The Claim Listing below will replace all prior versions of the claims in the application: 

Claim Listing : 

1 . (Withdrawn) A method for automatically processing a representation ol U multimedia — 
presentation having multiple information strearm contained therein, the method 
comprising the steps of: / 

(a) matching observed event cues detects within at least one information stream of 
the multimedia presentation with a model of expected event cues for a class of 
presentations to which the specifi/ multimedia presentation belongs; and 

(b) selecting presentation segmentsyof the multimedia presentation based upon the 
results of matching observed event cues with the model of expected event cues. 

2. (Withdrawn) A method as in Claim 1 wherein the step of selecting presentation segments 
is implemented using a finite state machine having the expected event cues as state 
transitions. / 

3. (Withdrawn) A method as in Claim 1 wherein the expected event cues comprise a 
plurality of time difference Joased cues. 

4. (Withdrawn) A method sys in Claim 1 wherein the expected event cues comprise a 
plurality of intrastream (Sues taken from a given information stream. 

5. (Withdrawn) A method as in Claim 1 wherein the expected event cues comprise 
interstream cues tak£n from more than one information stream, and the step of selecting 
presentation segments comprises correlating the interstream event cues. 

6. (Withdrawn) A method as in Claim 1 wherein the expected event cues are taken from a 
text information stream. 

7. (Withdrawn/A method as in Claim 6 wherein the expected event cues are closed 
captioned word cues. 
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8. (Withdrawn) A method as in Claim 6 wherein the expec/ed event cues are closed 
captioned punctuation cues. 

9. (Withdrawn) A method as in Claim 6 wherein the e/pected event cues are token phrases 
for the class of multimedia presentation. 

10. (Withdrawn) A method as in Claim 9 wherein thfe token phrases comprise text strings. 

1 1 . (Withdrawn) A method as in Claim 9 wherei^i the token phrases comprise closed 
captioned punctuation cues. 

12. (Withdrawn) A method as in Claim 1 1 v^herein the close captioned punctuation cues are 
selected from the group consisting of 7>>", "»>", and ":". 



13. (Withdrawn) A method as in Clairy 9 wherein the token phrases comprise a named entity 
and a text string. 

14. (Withdrawn) A method as in 01aim 13 wherein the token phrases include Tm" followed 
by a <person> named entity .y 



15. (Withdrawn) A method zl in Claim 9 wherein the token phrases comprise a named entity 
and a closed captioned minctuation cue. 

16. (Withdrawn) A method as in Claim 15 wherein the token phrases include a <person> 
named entity followed by a 

17. (Withdrawn) A method as in Claim 9 wherein the token phrases comprise introductory 
news broadcasts terms. 



18. (Withdrawn/ A method as in Claim 17 wherein at least one token phrase is selected from 
the group Consisting of "I'm", "hello", "welcome", "hello from", "welcome to", "thanks 
for watcmng", "thanks for joining us", and "here on". 
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(Withdrawn) A method as in Claim 9 wherein the token phrasfes comprise anchor to 
reporter hand-off phrases. / 

(Withdrawn) A method as in Claim 19 wherein at least o/e token phrase comprises a 
reporter named entity. / 

(Withdrawn) A method as in Claim 19 wherein at least one token phrase is selected from 
the group consisting of a station identification wittf a reporter named entity, a reporter 
named entity with the phrase "joins us", and a reporter named entity with the phrase 
"reports". / 

(Withdrawn) A method as in Claim 9 wherdri the token phrases comprise reporter to 
anchor hand-off phrases. / 

(Withdrawn) A method as in Claim 22 wherein at least one token phrase is selected from 
the group consisting of a station identification with a reporter named entity, a reporter 
named entity with a located named entity, "back to you", and "thank you". 

(Withdrawn) A method as in Claim 9 wherein the token phrases comprise leaders to 
highlights of upcoming news stories. 

(Withdrawn) A method as iryClaim 24 wherein at least one token phrase is selected from 
the group consisting of "coming up", "next on", "ahead on", "when" together with a 
station identification and /returns", and "also ahead". 

(Withdrawn) A methoci as in Claim 9 wherein the token phrases comprise sign off 
phrases. / 

(Withdrawn) A method as in Claim 26 wherein at least one token phrase is selected from 
the group consisting of "that wraps up", "that is all", "that's all", "that's" together with a 
news program identification, "thanks for watching", and "thanks for joining us". 

(Withdrawrf) A method as in Claim 6 wherein the expected event cues are named entities. 



(Withdrawn) A method as in Clam 28 wherein the named entities are selected from the 
group consisting of persons, locations, organizations, times, oates and monetary values. 

(Withdrawn) A method as in Claim 1 wherein the model pi expected event cues is 
developed from observed event cues occurring in a clas/of media presentations. 

(Withdrawn) A method as in Claim 28 wherein the model of expected event cues is 
developed by statistical analysis of observed event /ues. 

(Withdrawn) A method as in Claim 1 wherein ttfe expected event cues are taken from an 
image information stream. / 

(Withdrawn) A method as in Claim 32 wherein the expected event cues are selected from 
the group consisting of black frame, logo /frame, single anchor frame, double anchor 
frame, and reporter frame. / 

(Withdrawn) A method as in Claim V wherein the expected event cues are taken from an 
audio information stream. / 

(Withdrawn) A method as in Clsfim 34 wherein the expected event cues are selected from 
the group consisting of silence/letection, speaker change detection, and jingle detection. 

(Withdrawn) A method as in Claim 1 wherein the expected event cues are indications of 
news stories. / 

(Withdrawn) A methocyas in Claim 34 wherein the expected event cues are selected from 
the group consisting of before start of broadcast, start of broadcast, highlight segment, 
advertising, story start, story end, before end of broadcast, and end of broadcast. 



(Currently Amended) A method fo r automatically pr ocessing a representation of a 
multimedia pr csptation having multipl e information str e ams contain e d th ere in, the 
method as in C/aim 59 further comprising the steps of: 
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(a) s e l e cting at l e ast one contiguous portion of the multimedia pr esentation as a story 

s e gment, 

(b) J(e) extracting text information from a text information /tream corresponding to the 

story segment as text data; 
fe)(f) extracting story summary data from the text data; y 

(d) e xt r acting named entiti e s from the text data ^nd 

(e) (g) linking together a stored representation of ^ne text data, summary data, and named 

entity data for the story segment. 



39. (Currently Amended) A method as in Claimy38 wherein the method additionally 
comprising comprises the steps of: 

(f) storing the representations of the/ext data, summary data, and named entity data 
for story segments as one or m^re files on a file server computer connected to a 
computer network; and 

(g) allowing access to the storeof representations of news story segments available to a 
browser program running pn at least one client computer connected to the 
computer network. 



40. (Currently Amended) A method for automatically p r oc e ssing a representation of a 
multimedia presentation haying multipl e information streams contained th er ein, th e 
method as in Claim 59 furftier comprising the steps of: 

(a) s e l e cting at least fine contiguous portion of th e multim e dia p re sentation as a story 

segm e nt ; 

fb) e xt r acting t e xtfinformation from a t e xt information st re am co r responding to the 

story segmcm as t e xt data; 

fe) extracting yarned entiti e s from the text data; and 

fd)(e) extractingrstory summary data using the named entities as a basis. 



41 . (Original) A rriethod as in Claim 40 wherein the step of extracting story summary data 
additionally comprises the step of: 

(a) determining a frequency of occurrence for the named entities per sentence in a 
story segment; and 
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(b) selecting a sentence with a greatest named entity frequency of occurrence as a 
topic sentence. / 

42. (Original) A method as in Claim 41 wherein step (b) of selecting a sentence additionally 
comprises the step of: / 

(i) if more than one sentence has a greates/ named entity frequency of 

occurrence, selecting the sentence clo/est to the beginning of the story as 
the topic sentence. / 

43 . (Currently Amended) A method fo r automatically proc e ssing a representation of a 
multimedia pr e s e ntation having multiple information streams contained the r ein, the 
method as in Claim 59 wherein step (a) of selecting at least one contiguous portion of the 
multimedia presentation as a story segment / additionally comprises a step of : . 
matching a model of expected event cues with observed event cues in at least one 
information stream[[;]] / 

(b) p r es e nting a summary display off the story segment including one or mo re nam e d 
entities ext r acted from a text /t r cam together with a key frame extracted from an 
imag e ry st r eam . / 

44. (Currently Amended) A method y for automatically processing a r e presentation of a 
multim e dia pr e s e ntation having multiple information streams contain e d th e rein, the 
method as in Claim 59 furthe/ comprising the step of: 

fa) s e lecting at l e ast onycontiguous portion of the multimedia presentation as a story 
s e gm e nt; and / 

fb) (e) selecting a key frame from an imagery stream in the multimedia presentation 

representative oythe segment based upon the type of segment. 

45. (Original) A method as in Claim 44 wherein the story segment contains a reporter 
segment and the keyframe is selected from the middle of the reporter segment. 

46. (Original) A mel 
segment and the 



)d as in Claim 44 wherein the story segment contains an anchor booth 
cey frame is selected from the middle of the anchor booth segment. 



(Currently Amended) A method fo r p r esenting a summary r ep r es e ntation of a multimedia 
presentation having multiple information streams cont/in e d therein, the method as in 



Claim 59 further comprising the steps of: 

fa){e} in response to a search query, selecting multip le contiguous portions of the 

multimedia presentation as story segments/and 
fb%f) in response to a search query , presenting ar summary display having multiple 

summary presentation elements representative of the extracted story segments. 

(Original) A method as in Claim 47 wherein ^ne summary presentation elements from a 
given story segment are displayed together. 

(Currently Amended) A method as in Claim 48 wherein the summary presentation 
elements comprise extracted named entities. 

(Original) A method as in Claim 48 vynerein the summary presentation elements comprise 
summary sentences. 

(Original) A method as in Claim 48 wherein the summary presentation elements comprise 
a hyperlink to a source media elefnent of the segment. 

(Currently Amended) A method as in Claim 48 wherein step (b%0 of presenting a 
summary display additionally comprises the step of: 

presenting extracted mmed entities in a hypertext link form such that hyperlinks 
lead to presentation of additional elements of the story segment. 

(Currently Amended) A method as in Claim 43 47 wherein step fb) (0 of presenting a 
summary display additionally comprises the step of: 

in response to a search query for a selected named entity, presenting a thumbnail 
view comprising key frames from multiple story segments containing the selected named 
entity. 

(Currently Amended) A method as in Claim 43 47 wherein step (b) (0 of presenting a 
summary display/additionally comprises the step of: 
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in response to a search query for a story segment/of a selected type, presenting a 
thumbnail view comprising key frames from multiple story segments of the selected type. 




5 5 . (Currently Amended) A method fo r automatically processing a r ep r esentation of a 
multimedia p r esentation having multiple infomiatyon str e ams contained therein, the 
method as in Claim 59 additionally comprising tMe steps of: 

(a) s e lecting at l e ast on e contiguous portioy of th e multim e dia p re s e ntation as a story 
s e gm e nt ; 

(b) (e) extracting information from at least ^ne information stream corresponding to the 

story segment as source data; 
fe)(l) extracting a summary representation of the story segment from the source data; 
and 

(d)(g) presenting a plurality of related story segments using a layered hierarchical 

presentation of the summary Representations at a relatively high hierarchical level 
and the source data at a relatively low hierarchical level, together with hyperlinks 
permitting navigation amg/ng related story segments to a desired hierarchical level 
of representation. 



56. (Currently Amended) A method as in Claim 55 wherein the information stream is a text 
stream, the source data is text relating to a story segment, and the summary representation 
includes extracted named mitities. 

57. (Original) A method as /n Claim 55 wherein the information stream is an image stream, 
the source data is image data for the complete story segment, and the summary 
representation is a key frame. 



58. Canceled 

59. (Previously Presented) A method for automatically processing a representation of a 
multimedia presentation having multiple information streams contained therein, the 
method comprising the steps of: 

(a) selecting at least one contiguous portion of the multimedia presentation as a story 
segment; 

7 
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(b) extracting named entities from a text information stream corresponding to the 
story segment; / 

(c) using extracted named entities as sea^h criteria to select from among a plurality 
of story segments; and / 

(d) in response to a search query, presenting a list of named entities and their 
corresponding number of occurrences in story segments over a selected time 
period. / 

(Previously Amended) A metho/ as in Claim 59 additionally comprising the step of: 

(e) in response to a search^uery, presenting a graph of named entities and their 
corresponding frequency of occurrences in story segments over a selected time 
period. / 

(Previously Presented) A method as in Claim 60 additionally comprising the step of: 

(f) in response to /election of a point on the graph of named entities, presenting the 
user with an Overview story segments containing the selected named entity. 

(Previously Presa/nted) A method as in Claim 59 additionally comprising the step of: 

(g) in response to a search query for a story segments of a selected type, presenting a 
thumbnail view comprising key frames from multiple story segments of the 
selected type. 



